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(54) ENCODING METHOD AND DECODING METHOD OF MOVING IMAGE 



(57) A moving picture coding method for coding a 
picture with switching between frame coding and field 
coding adaptively on a block-by-block basis includes: 
determining the maximum number of reference indices 
for field coding for specifying fields which are to be re- 
ferred to at the time of field coding, using the maximum 
number of reference indices for frame coding for spec- 
ifying frames which are to be referred to at the time of 
frame coding; and assigning to fields the reference in- 
dices for field coding for specifying fields which are to 
be referred to at the time of field coding, within a range 
of the determined maximum number thereof, using the 
reference indices for frame coding for specifying frames 
which are to be referred to at the time of frame coding. 
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Description 

Technical Field 

[0001] The present invention relates to a moving pic- 
ture coding method and a moving picture decoding 
method, and particularly to a coding method and a de- 
coding method for performing inter-picture prediction 
with reference to previously coded pictures. 

Background Art 

[0002] With development of multimedia applications, 
it has been popularto handle integrally all kinds of media 
information such as video, audio and text. Since digi- 
tized images have an enormous amount of data, image 
information compression techniques are absolutely es- 
sential for storage and transmission of such information. 
It is also important to standardize such compression 
techniques for interoperation of compressed image da- 
ta. There exist international standards for image com- 
pression techniques, such as H.261 and H.263 stand- 
ardized by ITU-T (International Telecommunication Un- 
ion - Telecommunication Standardization Sector) and 
MPEG-1, MPEG-2 and MPEG-4 standardized by ISO 
(International Organization for Standardization). ITU is 
now working for standardization of H.26L as the latest 
standard for image coding. 

[0003] Coding of moving pictures, in general, com- 
presses information amount by reducing redundancy in 
both temporal and spatial directions. Therefore, in inter- 
picture prediction coding, which aims at reducing the 
temporal redundancy, motion of a current picture is es- 
timated on a block-by-block basis with reference to pre- 
ceding or subsequent pictures so as to generate predic- 
tive images of the current picture, and then differential 
values between the obtained predictive images and the 
current picture are coded. 

[0004] Here, the term "picture" represents a single 
sheet of an image, and it represents a frame when used 
in a context of a progressive image, whereas it repre- 
sents a frame or a field in a context of an interlaced im- 
age. The interlaced image here is a single frame that is 
made up of two fields having different times respectively. 
In the process of coding and decoding the interlaced im- 
age, a single frame can be handled as a frame, as two 
fields, or as a frame structure or a field structure on every 
block in the frame. 

[0005] The following description will be given assum- 
ing that a picture is a frame in a progressive image, but 
the same description can be given even assuming that 
a picture is a frame or a field in an interlaced image. 
[0006] Fig. 35 is a diagram for explaining types of pic- 
tures and reference relations between them. 
[0007] A picture like Picture 11 , which is /nfra-picture 
prediction coded without reference to any pictures, is re- 
ferred to as an l-picture. A picture like Picture P10, which 
is /nter-picture prediction coded with reference to one 



2 

picture, is referred to as a P-picture. And a picture, which 
can be /nter-picture prediction coded with reference to 
two pictures at the same time, is referred to as a B-pic- 
ture. B-pictures, like Pictures B6, B12 and B18, can refer 

5 to two pictures located in arbitrary temporal directions. 
Reference pictures can be specified on a block-by-block 
basis, on which motion is estimated, and they are dis- 
criminated between a first reference picture which is de- 
scribed earlier in a bit stream including the coded pic- 

10 tures and a second reference picture which is described 
later in the bit stream. However, it is required in order to 
code and decode above pictures that the reference pic- 
tures be already coded and decoded. Figs. 36A and 36B 
show examples of order of pictures in which B-pictures 

15 are coded and decoded. Fig. 36A shows a display order 
of the pictures, and Fig. 36B shows a coding and de- 
coding order reordered from the display order as shown 
in Fig. 36A. These drawings show that the pictures are 
reordered so that the pictures which are referred to by 

20 Pictures B3 and B6 are previously coded and decoded. 
[0008] Next, reference indices for specifying refer- 
ence pictures will be explained with reference to Fig. 37 
and Fig. 38. For the sake of simplicity, numbers for iden- 
tifying actual pictures are referred to as picture numbers, 

25 while numbers used for specifying reference pictures for 
inter-picture prediction are referred to as reference in- 
dices. Particularly, indices indicating first reference pic- 
tures and second reference pictures are referred to as 
first reference indices and second reference indices, re- 

30 spectively. Default values as shown in Fig. 37 are usu- 
ally assigned to the reference indices in an initial state, 
but the assignment can be changed according to com- 
mands. 

[0009] Fig. 37 shows the assignment of two reference 

35 indices to the picture numbers in the initial state of frame 
coding, and Fig. 38 shows an assignment of reference 
indices updated using commands from the assignment 
as shown in Fig. 37. When there is a sequence of pic- 
tures ordered in coding order, picture numbers are as- 

40 signed to the pictures stored in a memory in coding or- 
der. Commands for assigning the reference indices to 
the picture numbers are described in a header of a slice 
that is the smaller unit of coding than a picture, and thus 
the assignment can be updated every time one slice is 

45 coded. It is possible to use a differential value between 
an original picture number and an updated picture 
number as the above command and code an arbitrary 
number of such commands as a command sequence. 
The first command in the command sequence is applied 

50 to a picture number of a current picture and indicates a 
picture number corresponding to a reference index 
number "0". The second command in the command se- 
quence is applied to the picture number corresponding 
to the reference index number "0" and indicates a pic- 

55 ture number corresponding to a reference index number 
"1 ". The third command is applied to the picture number 
corresponding to the reference index number "1" and 
indicates a picture number corresponding to a reference 
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index number "2". The same applies to the fourth and 
the following commands. In the example of the first ref- 
erence indices in Fig. 38, a command "-2" is given first 
and thus the reference index number "0" is assigned to 
the picture with its number "1 1 " by adding "-2" to the pic- 5 
ture number "13" of the current picture. Next, a com- 
mand "+1 " is given and thus the reference index number 
"1" is assigned to the picture with its number "12" by 
adding "+1 " to the picture number "1 1 " corresponding to 
the reference index number "0". The following picture 10 
numbers are assigned to the reference index numbers 
in the same manner. The same goes for the second ref- 
erence indices. 

[0010] Fig. 39 is a schematic diagram showing an ex- 
ample of a bit stream generated as a result of the above- 15 
mentioned coding. As shown in this figure, the maximum 
number of reference indices Max_idx1 for the first ref- 
erence pictures (refl) and the maximum number of ref- 
erence indices Max_idx2 for the second reference pic- 
tures (ref2) are described in the picture common infor- 20 
mation of the bit stream, and the reference index assign- 
ment command sequences idx_cmd1 and idx_cmd2for 
refl and ref2 are described in the slice header. 
[001 1 ] A document related to the above conventional 
technology is ITU-T Rec. H.264 I ISO/I EC 14496-10 25 
AVC Joint Final Committee Draft of Joint Video Specifi- 
cation (2002-8-10) (P.54, 8.3.6.3 Default index orders/ 
P.56, 8.3.6.4 Changing the default index orders). 
[0012] By the way, as a method of coding an inter- 
laced image, frame coding and field coding can be used 30 
by switching them per block in one picture. This is re- 
ferred to as Macroblock Adaptive Frame/Field Coding 
(hereinafter referred to as MBAFF). In this method, 
frame coding and field coding can be switched per a pair 
of two macroblocks placed above and below, as shown 35 
in Fig. 40. In a case of frame coding, both macroblocks 
are coded as a frame structure, while in a case of field 
coding, a macroblock consisting of odd-numbered lines 
and a macroblock consisting of even-numbered lines 
are coded separately. 40 
[0013] In MBAFF, as shown in Figs. 41 A and 41 B, ref- 
erence pictures are used for reference by switching 
them between a frame structure and a field structure de- 
pending on the coding methods of the macroblock pairs. 
When a current macroblock pair is coded as a frame 45 
structure as shown in Fig. 41 A, Pictures P1 - P3 are 
referred to as frames. When a current macroblock pair 
is coded as a field structure as shown in Fig. 41 B, the 
pictures are separated into top fields and bottom fields, 
Pictures P1T-P3B, and referred to as respective fields, so 
At this time, the number of reference pictures, which is 
the number of top and bottom fields, is twice the number 
of frames. 

[0014] However, the maximum number of reference 
indices (See max_idx1 and max_idx2 in Fig. 39) and the ss 
command sequences (See idx_cmd1 and idx_cmd2 in 
Fig. 39) for updating the assignment, which are used for 
assigning reference indices to respective pictures, can- 
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not be applied to both frames and fields at the same 
time. Therefore, there is a problem that the maximum 
number of reference indices and the assignment com- 
mands cannot be appropriately determined in a case of 
MBAFF. 

Disclosure of Invention 

[0015] Against this backdrop, the present invention 
aims at providing a picture coding method and a picture 
decoding method for applying reference indices appro- 
priately to either frame coding or field coding in a case 
of MBAFF. 

[0016] In order to achieve this object, the coding 
method according to the present invention is a moving 
picture coding method for coding a picture with switch- 
ing between frame coding and field coding adaptively 
on a block-by-block basis, comprising an assignment 
step of assigning field reference indices to fields using 
frame reference indices, the field reference indices 
specifying fields which are referred to at the time of field 
coding, and the frame reference indices specifying 
frames which are referred to at the time of frame coding. 
[001 7] According to this structure, frame reference in- 
dices can be used for assigning field reference indices. 
In other words, frame reference indices can be applied 
appropriately not only to frame coding but also to field 
coding. 

[0018] Here, the above-mentioned moving picture 
coding method may further comprise a specification 
step of specifying two fields that make up each of the 
frames specified by each of the frame reference indices, 
and in the assignment step, a first value may be as- 
signed to one field having a parity same as a parity of a 
field including a current block to be coded, out of the 
specified two fields, as each of the field reference indi- 
ces, the first value being obtained by doubling a value 
of said each of the frame reference indices, and a sec- 
ond value may be assigned to another field having a par- 
ity different from a parity of the field including the current 
block as said each of the field reference indices, the sec- 
ond value being obtained by adding one to said first val- 
ue. 

[001 9] According to this structure, the value obtained 
by doubling the value of the frame reference index and 
the value obtained by adding one to the doubled value 
are assigned to the field reference indices depending 
on the field parity. Therefore, the field reference indices 
can be assigned extremely easily using the frame refer- 
ence indices. 

[0020] Here, the above-mentioned moving picture 
coding method may further comprise a determination 
step of determining a maximum number of the field ref- 
erence indices to be a value obtained by doubling a 
maximum number of the frame reference indices, and 
in the assignment step, the field reference indices may 
be assigned within a range of the determined maximum 
number. 
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[0021] According to this structure, the number ob- 
tained by doubling the maximum number of frame ref- 
erence indices can be assigned as the field reference 
indices, and thus the effective use of the frame refer- 
ence indices can be maximized. s 
[0022] Here, the above-mentioned moving picture 
coding method may further comprise a specification 
step of specifying two fields that make up each of the 
frames specified by each of the frame reference indices, 
the two fields being a top field and a bottom field, and 10 
in the assignment step, a first value may be assigned to 
the top field, out of the specified two fields, as each of 
the field reference indices, the first value being obtained 
by doubling a value of said each of the frame reference 
indices, and a second value may be assigned to the bot- 15 
torn field as said each of the field reference indices, the 
second value being obtained by adding one to said first 
value. 

[0023] The above-mentioned moving picture coding 
method may further comprise a specification step of 20 
specifying two fields that make up each of the frames 
specified by each of the frame reference indices, and in 
the assignment step, a value same as a value of said 
each of the frame reference indices may be assigned 
only to one field having a parity same as a parity of a 25 
field including a current block to be coded, out of the 
specified two fields, as each of the field reference indi- 
ces. 

[0024] Here, the above-mentioned moving picture 
coding method may further comprise an addition step of 30 
generating a command sequence indicating how to as- 
sign the frame reference indices and a command se- 
quence indicating how to assign the field reference in- 
dices independently, coding said two command se- 
quences, and adding said coded command sequences 35 
to a coded signal. 

[0025] The above-mentioned moving picture coding 
method, wherein the field reference indices consist of 
top field reference indices and bottom field reference in- 
dices, may further comprise an addition step of gener- 40 
ating a command sequence indicating how to assign the 
frame reference indices, a command sequence indicat- 
ing how to assign the top field reference indices and a 
command sequence indicating how to assign the bottom 
field reference indices independently, coding said three 45 
command sequences, and adding said coded command 
sequences to a coded signal. 

[0026] The above-mentioned moving picture coding 
method may further comprise a determination step of 
determining a maximum number of the field reference so 
indices, and in the assignment step, the field reference 
indices may be assigned to fields within a range of the 
determined maximum number using the frame refer- 
ence indices. 

[0027] Here, in the determination step, the maximum 55 
number of the field reference indices may be determined 
to be a value obtained by doubling a maximum number 
of the frame reference indices. 



[0028] According to this structure, the frame refer- 
ence indices can be used effectively at the maximum for 
the field reference indices within the number obtained 
by doubling the maximum number of frame reference 
indices. 

[0029] Here, in the determination step, the maximum 
number of the field reference indices maybe determined 
to be a value same as a maximum number of the frame 
reference indices. 

[0030] According to this structure, the frame refer- 
ence indices can be used effectively at the maximum for 
the field reference indices within the number same as 
the maximum number of frame reference indices. 
[0031] Here, the above-mentioned moving picture 
coding method may further comprise an addition step of 
determining a maximum number of the frame reference 
indices independently of the maximum number of the 
field reference indices, coding said two maximum num- 
bers, and adding said coded maximum numbers to a 
coded signal. 

[0032] According to this structure, the maximum 
number of the field reference indices can be determined 
independently of the maximum number of the frame ref- 
erence indices, and the decoding apparatus can notify 
the determined maximum number via a coded signal. 
[0033] Here, the above-mentioned moving picture 
coding method, wherein the field reference indices con- 
sist of top field reference indices and bottom field refer- 
ence indices, may further comprise an addition step of 
determining a maximum number of the frame reference 
indices, a maximum number of the top field reference 
indices and a maximum number of the bottom field ref- 
erence indices independently, coding said three maxi- 
mum numbers, and adding said coded maximum num- 
bers to a coded signal. 

[0034] As described above, according to the coding 
method of the present invention, the reference indices, 
the maximum number of the reference indices and the 
commands that are originally intended for frame coding 
can also be utilized appropriately in field coding, in a 
case of MBAFF. 

[0035] Also, the moving picture decoding method, the 
moving picture coding apparatus, the moving picture de- 
coding apparatus and the program of the present inven- 
tion have the same structures, functions and effects as 
mentioned above. 

Brief Description of Drawings 

[0036] 

Fig. 1 is a block diagram showing a structure of a 
coding apparatus in a first embodiment of the 
present invention. 

Fig. 2 is an illustration showing an example of cor- 
respondences between picture numbers and first 
and second reference indices in a case of frame 
coding of macroblocks (MB). 
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Fig. 3 is an illustration showing an example of cor- 
respondences between the first and second refer- 
ence indices, commands and picture numbers. 
Fig. 4 is an illustration showing an example of as- 
signing the first and second reference indices to the s 
picture numbers of fields in a case of field coding of 
mac rob locks. 

Fig. 5 is a flowchart showing the processing of as- 
signing reference indices and commands executed 
by a reference index/picture number conversion 10 
unit in the coding apparatus. 
Fig. 6 is a flowchart showing the processing of as- 
signing reference indices for field coding to fields. 
Fig. 7 is a block diagram showing a structure of a 
decoding apparatus in the first embodiment of the *s 
present invention. 

Fig. 8 is a block diagram showing a structure of a 
coding apparatus in a second embodiment of the 
present invention. 

Fig. 9 is an illustration showing an example of as- 20 
signing the first and second reference indices to pic- 
ture numbers of fields in a case of field coding of a 
macroblock. 

Fig. 1 0 is a flowchart showing the processing of as- 
signing reference indices executed by a reference 25 
index/picture number conversion unit in the coding 
apparatus. 

Fig. 11 is a block diagram showing a structure of a 
decoding apparatus in the second embodiment of 
the present invention. 30 
Fig. 12 is a block diagram showing a structure of a 
coding apparatus in a third embodiment of the 
present invention. 

Fig. 13 is an illustration showing an example of as- 
signing the first and second reference indices to pic- 35 
ture numbers of fields in a case of field coding of a 
macroblock. 

Fig. 14 is a block diagram showing a structure of a 
decoding apparatus in the third embodiment of the 
present invention. 40 
Fig. 15 is a block diagram showing a structure of a 
coding apparatus in a fourth embodiment of the 
present invention. 

Fig. 16 is an illustration showing an example of as- 
signing the first and second reference indices to pic- *s 
ture numbers of fields in a case of field coding of a 
macroblock. 

Fig. 17 is a block diagram showing a structure of a 
coding apparatus in a fifth embodiment of the 
present invention. so 
Fig. 18 is an illustration showing an example of as- 
signing the first and second reference indices to pic- 
ture numbers of fields in a case of field coding of a 
macroblock. 

Fig. 1 9 is a flowchart showing the processing of as- 55 
signing reference indices executed by a reference 
index/picture number conversion unit in the coding 
apparatus. 



Fig. 20 is a block diagram showing a structure of a 
decoding apparatus in the fifth embodiment of the 
present invention. 

Fig. 21 is a diagram showing a data structure of a 
bit stream in a sixth embodiment of the present in- 
vention. 

Fig. 22 is an illustration showing an example of as- 
signing the first and second reference indices to pic- 
ture numbers of fields in a case of field coding of a 
macroblock. 

Fig. 23 is a block diagram showing a structure of a 
coding apparatus in a seventh embodiment of the 
present invention. 

Fig. 24 is a diagram showing an example of a data 
structure of a bit stream. 

Fig. 25 is an illustration showing an example of as- 
signing the first and second indices to picture num- 
bers of fields in a case of field coding of a macrob- 
lock. 

Fig. 26 is a diagram showing an example of corre- 
spondences between reference indices, com- 
mands and picture numbers of fields specifically ap- 
plied to top fields and bottom fields respectively in 
a case of field coding. 

Fig. 27 is a flowchart showing the processing of as- 
signing reference indices and commands in a case 
of a mixture of frame coding and field coding. 
Fig. 28 is a block diagram showing a structure of a 
decoding apparatus in the seventh embodiment of 
the present invention. 

Fig. 29 is a diagram showing another example of a 
data structure of a bit stream. 
Figs. 30A, B and C are illustrations of a recording 
medium for storing a program for realizing the mov- 
ing picture coding method and moving picture de- 
coding method in each of the embodiments by a 
computer system. 

Fig. 31 is a block diagram showing an overall con- 
figuration of a content supply system. 
Fig. 32 is an external view of a mobile phone. 
Fig. 33 is a block diagram showing a structure of 
the mobile phone. 

Fig. 34 is a diagram showing an example of a digital 
broadcasting system. 

Fig. 35 is a schematic diagram for explaining refer- 
ence relations between pictures in a background 
art. 

Figs. 36A and B are schematic diagrams for ex- 
plaining reordering of pictures in the background 
art. 

Fig. 37 is a schematic diagram for explaining how 
to assign picture numbers to reference indices in 
the background art. 

Fig. 38 is a schematic diagram showing assignment 
of reference indices updated from the assignment 
as shown in Fig. 37 using commands in the back- 
ground art. 

Fig. 39 is a schematic diagram for explaining a 
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structure of a bit stream in the background art. 

Fig. 40 is an illustration of macroblock pairs in cases 

of frame coding and field coding. 

Figs. 41 A and B are illustrations showing reference 

frames in frame coding and reference fields in field 

coding. 

Best Mode for Carrying Out the Invention 
(First Embodiment) 

<Overview of Coding Apparatus and Decoding 
Apparatus> 

[0037] First, an overview of a coding apparatus and a 
decoding apparatus in the present embodiment will be 
given. 

[0038] When performing macroblock adaptive frame/ 
field coding (MBAFF), the coding apparatus and the de- 
coding apparatus in the present embodiment handle the 
maximum number of reference indices and a command 
sequence in the following manners (1.1) and (1.2), re- 
spectively. Here, the reference indices and the com- 
mands are same as those as shown in Fig. 38, and the 
maximum number of the reference indices are same as 
those as shown in Fig. 39. 

[0039] (1 . 1 ) As for the maximum number of the refer- 
ence indices, the coding apparatus describes the max- 
imum number of reference indices for frame coding 
(frame reference indices) in a bit stream to be transmit- 
ted when field coding and frame coding are mixed. The 
coding apparatus handles the maximum number of ref- 
erence indices as the number of available reference in- 
dices in frame coding, while, in field coding, it considers 
the value obtained by doubling the maximum number 
for frame coding as the number of reference indices for 
field coding (field reference indices). For example, when 
the reference indices for frame coding 0-2 are as- 
signed, the maximum number of reference indices is "3". 
In a case of frame coding, this number indicates the ac- 
tual maximum number itself. In a case of field coding', 
the number "6" obtained by doubling the maximum 
number of reference indices forframe coding "3" is con- 
sidered as the maximum number of reference indices 
for field coding. The same applies to the decoding ap- 
paratus. 

[0040] (1 .2) As for the command sequence, the cod- 
ing apparatus describes commands for frame coding in 
a bit stream to be transmitted. The coding apparatus as- 
signs the reference indices for frame coding in a case 
of frame coding, as explained using Fig. 38. Note that if 
the command sequence is not coded, correspondences 
between picture numbers and reference indices are es- 
tablished in the manner of default assignment as shown 
in Fig. 37. 

[0041 ] In a case of field coding, the assignment of ref- 
erence indices is updated for field coding based on the 
reference indices forframe coding which are already as- 



signed. 

[0042] To be more specific, the value obtained by dou- 
bling the value of the reference index for frame coding 
is assigned to a field of the same parity as a field includ- 
5 ing a current macroblock to be coded, among two fields 
that make up one frame, while the value obtained by 
doubling the value of the reference index for frame cod- 
ing and adding 1 (x2+1) is assigned to another field of 
the opposite parity, as a reference index for field coding, 

10 respectively (See Fig. 4). Here, "parity" means an odd 
or even quality of a field (distinction between a top field 
consisting of odd-numbered lines and a bottom field 
consisting of even-numbered lines). 
[0043] In other words, when a current macroblock to 

15 be coded belongs to a top field, the value obtained by 
doubling a value of a reference index for frame coding 
is assigned to a top field among two fields, while the 
value obtained by adding 1 to the doubled value (x2+1 ) 
is assigned to a bottom field among the two fields. When 

20 a current macroblock belongs to a bottom field, the value 
obtained by doubling the value of the reference index 
for frame coding is assigned to a bottom field among 
two fields, while the value obtained by adding 1 to the 
doubled value (x2+1) is assigned to a top field among 

25 the two fields. 

[0044] On the other hand, the decoding apparatus de- 
codes the maximum number of reference indices for 
frame coding and the assignment commands included 
in the transmitted bit stream, and assigns the reference 

30 indices to the reference pictures, using the maximum 
number and the commands, in exactly the same manner 
as the coding apparatus. 

<Structure of Coding Apparatus> 

35 

[0045] Next, the structure of the coding apparatus will 
be explained. 

[0046] Fig. 1 is a block diagram showing the structure 
of the moving picture coding apparatus in the first em- 
40 bodiment of the present invention. Using the figure, (1 ) 
an overview of coding and (2) an assignment method of 
reference indices and commands for frame coding and 
an assignment method of reference indices for field cod- 
ing will be explained in this order. 

45 

(1 ) Overview of Coding 

[0047] It is assumed here that a current picture repre- 
sents either a frame or a field to be coded, and thus the 

50 overview of coding which is common to both frame cod- 
ing and field coding will be explained below. 
[0048] A moving picture to be coded is inputted to a 
picture memory 1 01 on a picture-by-picture basis in dis- 
play order, and the inputted pictures are reordered in 

55 coding order. Figs. 36A and 36B are diagrams showing 
an example of reordering of pictures. Fig. 36A shows an 
example of pictures in display order, and Fig. 36 B shows 
an example of the pictures reordered in coding order. 
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Here, since Pictures B3 and B6 refer both temporally 
preceding and subsequent pictures, the reference pic- 
tures need to be coded before coding these current pic- 
tures and thus the pictures are reordered in Fig. 36B so 
that Pictures P4 and P7 are coded earlier. Each of the 
pictures is divided into blocks called macroblocks of hor- 
izontal 16 x vertical 16 pixels, for example, and the fol- 
lowing proceeding is performed on a block-by-block ba- 
sis. 

[0049] An input image signal read out from the picture 
memory 101 is inputted to a difference calculation unit 
112, a difference between the input image signal and 
the predicted image signal that is an output from a mo- 
tion compensation coding unit 1 07 is calculated, and the 
obtained difference image signal (residual error signal) 
is outputted to a prediction error coding unit 102. The 
prediction error coding unit 102 performs image coding 
processing such as frequency transformation and quan- 
tization, and outputs a coded residual error signal. The 
coded residual error signal is inputted to a prediction er- 
ror decoding unit 104, which performs image decoding 
processing such as inverse-quantization and inverse- 
frequency transformation and outputs a decoded resid- 
ual error signal. An addition unit 111 adds the decoded 
residual error signal and the predicted image signal to 
generate a reconstructed image signal, and stores, in a 
picture memory 105, the reconstructed signals which 
could be referred in the following inter-picture prediction 
out of the obtained reconstructed image signals. 
[0050] On the other hand, the input image signal read 
out per macroblock from the picture memory 1 01 is also 
inputted into a motion vector estimation unit 106. Here, 
the reconstructed image signals stored in the picture 
memory 1 06 are searched to estimate an image area 
which is the closest to the input image signal and deter- 
mine a motion vector pointing to the position of the im- 
age area. The motion vector estimation is performed per 
block that is a part of a macroblock, and the obtained 
motion vectors are stored in a motion vector storage unit 
1 08. At this time, since a plurality of pictures can be used 
for reference in H.26L which is now under consideration 
for standardization, identification numbers for specifying 
reference pictures are required per block. The identifi- 
cation numbers are referred to as reference indices, and 
a reference index/picture number conversion unit 109 
establishes correspondences between the reference in- 
dices and the picture numbers of the pictures stored in 
the picture memory so as to allow specification of the 
reference pictures. 

[0051] The motion compensation coding unit 107 ex- 
tracts the image area that is most suitable for the pre- 
dicted image from among the reconstructed image sig- 
nals stored in the picture memory 1 05, using the motion 
vectors estimated by the above-mentioned processing 
and the reference indices. It is judged at this time which 
is more efficient, frame predictive coding or field predic- 
tive coding, in each macroblock, and then coding is per- 
formed using the selected method. The bit stream gen- 



12 

eration unit 103 performs variable length coding for the 
coded information such as the reference indices, the 
motion vectors and the coded residual error signals out- 
putted as a result of the above series of processing so 
5 as to obtain a bit stream to be outputted from this coding 
apparatus. 

[0052] The flow of operations in a case of inter-picture 
prediction coding has been described above, but a 
switch 1 1 2 and a switch 1 13 switch between inter-picture 
10 prediction coding and intra-picture prediction coding. In 
a case of intra-picture prediction coding, a predicted im- 
age is not generated by motion compensation, but a dif- 
ference image signal is generated by calculating a dif- 
ference from a predicted image in a current area which 
15 is generated from a coded area in the current picture. 
The prediction error coding unit 102 converts the differ- 
ence image signal into the coded residual error signal 
in the same manner as inter-picture prediction coding, 
the bit stream generation unit 103 performs variable 
20 length coding for the signal to obtain a bit stream to be 
outputted. 

(2) Assignment Method of Reference Indices 



[0053] First, Fig. 2~Fig. 4 show examples of assign- 
ment methods of reference indices for frame coding and 
reference indices for field coding. 

30 [0054] Fig. 2 shows an example of assignment of de- 
fault reference indices in a case where frame coding is 
performed on a block in a current picture to be coded, 
and the reference indices are assigned to the picture 
numbers in decreasing order of the picture number. The 

35 reference indices are always assigned in this manner 
when assignment commands are not coded. Fig. 3 
shows an example where the default reference indices 
as shown in Fig. 2 are updated using the assignment 
commands. Since "-2" is given first as a command, a 

40 picture with its picture number "11" is assigned to the 
reference index number "0" by adding "-2" to the current 
picture number "13". Next, "+1 " is given as a command, 
a picture with its picture number "12" is assigned to the 
reference index number "1". Each of the following pic- 

45 ture numbers is assigned in the same manner. The 
same applies to the second reference indices. The fol- 
lowing will be explained based on Fig. 2 showing the 
default assignment, but the reference indices can be as- 
signed in exactly the same manner even if the default 

50 assignment is updated by commands. Note that the 
above commands are just an example, and the refer- 
ence indices can be assigned in exactly the same man- 
ner even if the default assignment is updated by com- 
mands for other assignments than the above example. 

55 [0055] Fig. 4 is an illustration showing correspond- 
ences of the first and second reference indices for top 
field coding (top field reference indices) and bottom field 
coding (bottom field reference indices), respectively, up- 
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dated from the first and second reference indices for 
frame coding as shown in Fig. 2, according to the above 
(1.1) and (1 .2). Fig. 4 shows that the values obtained by 
doubling those of the reference indices for frame coding 
are assigned to the fields of the same parity as the field 
including a current macroblock, while the values ob- 
tained by doubling those of the reference indices for 
frame coding and adding 1 (x2+1 ) are assigned to the 
fields of the opposite parity. 

[0056] In the present embodiment, if field coding and 
frame coding are mixed in one picture, the maximum 
number of reference indices for field coding is handled 
as the value obtained by doubling that for frame coding, 
and thus the number of indices in Fig. 4 is "6", whereas 
the number of indices in Fig. 2 is "3". 

(Processing of Assigning Reference Indices) 

[0057] Fig. 5 is a flowchart showing the processing of 
assigning reference indices executed by the reference 
index/picture number conversion unit of the coding ap- 
paratus. 

[0058] The reference index/picture number conver- 
sion unit 109 performs the processing of assigning ref- 
erence indices per slice in a case of MBAFF. Here, a 
slice means each of one or more areas which make up 
a picture. The reference index/picture number conver- 
sion unit 1 09 omits all the processing in this figure when 
there is no change of reference indices (in a case of de- 
fault). 

[0059] As shown in this figure, the reference index/ 
picture number conversion unit 109 first performs the 
processing of assigning reference indices and com- 
mands for frame coding to frames (S11). Since this 
processing is same as that as described using Fig. 37, 
it is omitted here. Next, the reference index/picture 
number conversion unit 109 judges whether or not 
frame coding and field coding are mixed in the slice 
(S12), and if they are mixed, it performs the processing 
of assigning reference indices for field coding (S13). 
[0060] Fig. 6 is a flowchart showing the processing of 
assigning reference indices to fields based on the cor- 
respondences between reference indices forframe cod- 
ing and reference indices for field coding. In this figure, 
a variable / is 1 and 2 (/=1 , 2) for B-pictures and / is 1 
(/=1) for P-pictures, and maxjdxj indicates the maxi- 
mum number of the yth reference indices for frame cod- 
ing, and idxj(i) indicates the value of the ith-jth reference 
index forframe coding, respectively. Loop 2 can be ap- 
plied commonly to B-pictures and P-pictures. Loop 1 
has iterations for the maximum number of reference in- 
dices forframe coding (maxjdxj), and two reference in- 
dices for field coding are assigned for every iteration of 
loop 1. 

[0061] The processing of assigning two reference in- 
dices for field coding using one-iteration of loop 1 , that 
is, one reference index for frame coding, will be ex- 
plained below. The reference index/picture number con- 



version unit 1 09 reads out the value of the rth-/th refer- 
ence index for frame coding idxj(i) assigned in S11 of 
Fig. 5 (S23), and judges whether the current macroblock 
belongs to the top field or not (S26). 

5 [0062] When the current macroblock is judged to be- 
long to the top field, the value obtained by doubling that 
of the reference index for frame coding idxj(i) (S27) is 
assigned to the top field out of the two fields specified 
in S25 (S28), and the value obtained by doubling the 

10 value idxj(i) and adding 1 (S29) is assigned to the bottom 
field out of the two fields specified in S25 (S30). 
[0063] When the current macroblock is judged to be- 
long to the bottom field, the value obtained by doubling 
that of the reference index for frame coding idxj(i) (S31 ) 

is is assigned to the bottom field out of the two fields spec- 
ified in S25 (S32), and the value obtained by doubling 
the value idxj(i) and adding 1 (S33) is assigned to the 
top field out of the two fields specified in S25 (S34). 
[0064] As described above, the value obtained by 

20 doubling the value of the reference index for frame cod- 
ing and the value obtained by adding 1 to the doubled 
value (x2+1) are assigned to the reference indices for 
field coding. Therefore, as shown in Fig. 4, the value 
obtained by doubling the maximum number of reference 

25 indices for frame coding (maxjdxj) is assigned to the 
maximum number of reference indices for field coding. 
[0065] In coding a macroblock, reference indices for 
field coding used as reference fields in the field-coded 
macroblock are set in a bit stream as refl and ref2 (See 

30 Fig. 39). On the other hand, reference indices for frame 
coding used as reference frames in the frame-coded 
macroblock are set in a bit stream as refl and ref2 (See 
Fig. 39). 

[0066] The number of reference indices forframe cod- 
as ing is 3 in the example of Fig. 2, whereas the number of 
reference indices for field coding is 6 in the example of 
Fig. 4. 

[0067] Fig. 6 shows the processing of assigning ref- 
erence indices for field coding to each current picture to 

40 be field-coded, but a table may be prepared in advance. 
To be more specific, the present embodiment may be 
structured so as to create a table indicating correspond- 
ences between reference indices forframe coding and 
picture numbers of frames according to commands, and 

45 further, by assigning the reference indices for top field 
coding and bottom-field coding respectively in the same 
manner as shown in Fig. 6, to create a table indicating 
correspondences between reference indices for top 
field coding and picture numbers of fields and a table 

50 indicating correspondences between reference indices 
for bottom field coding and picture numbers of fields. 
Once these tables are created at the beginning of coding 
or decoding pictures, the reference pictures can be de- 
termined only with reference to the reference indices in- 

55 dicated in these tables. 
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(Structure of Decoding Apparatus) 

[0068] Fig. 7 is a block diagram showing a structure 
of a decoding apparatus in the first embodiment of the 
present invention. Using this figure, (1) an overview of 5 
decoding and (2) processing of converting reference in- 
dices will be explained in this order. Here, it is assumed 
that a bit stream is transmitted from the coding appara- 
tus as shown in Fig. 1 to the present decoding appara- 
tus, w 

(1) Overview of Decoding 

[0069] First, a bit stream analysis unit 201 extracts 
various information from the inputted bit stream: the *s 
maximum number of reference indices from a picture 
common information area, command sequences for ref- 
erence index assignment from a slice header area, and 
reference indices, motion vector information and a cod- 
ed residual error signal from a coded block information 20 
area, respectively. 

[0070] The maximum number of reference indices 
and the command sequences for reference index as- 
signment extracted by the bit stream analysis unit 201 
are outputted to a reference index/picture number con- 25 
version unit 206, the reference indices are outputted to 
a motion compensation decoding unit 204, the motion 
vector information is outputted to a motion vector stor- 
age unit 205, and the coded residual error signal is out- 
putted to a prediction error decoding unit 202, respec- 30 
tively. 

[0071] The prediction error decoding unit 202 per- 
forms image decoding processing such as inverse- 
quantization and inverse-frequency transformation for 
the inputted coded residual error signal, and outputs a 35 
decoded residual error signal. The addition unit 207 
adds the decoded residual error signal and the predicted 
image signal outputted from the motion compensation 
decoding unit 204 to generate a reconstructed image 
signal. The obtained reconstructed image signal is *o 
stored in a picture memory 203 for use for reference in 
the following inter-picture prediction and output for dis- 
play. 

[0072] The motion compensation decoding unit 204 
extracts an image area which is most suitable as a pre- 45 
dieted image from the reconstructed image signals 
stored in the picture memory 203, using the motion vec- 
tors inputted from the motion vector storage unit 205 and 
the reference indices inputted from the bit stream anal- 
ysis unit 201 . At this time, the reference index/picture so 
number conversion unit 206 specifies the reference pic- 
tures in the picture memory 203 based on the corre- 
spondences between the given reference indices and 
the picture numbers. If field coding is mixed, it specifies 
reference fields after converting the reference indices 55 
for frame coding into the reference indices for field cod- 
ing. 

[0073] Further, the motion compensation decoding 



unit 204 performs pixel value conversion processing 
such as interpolation processing by linear prediction on 
pixel values in the extracted image area so as to gener- 
ate the ultimate predicted image. The decoded image 
generated through the above-mentioned series of 
processing is stored in the picture memory 203 and out- 
putted as a picture signal for display according to display 
timing. 

[0074] The flow of operations in a case of inter-picture 
prediction decoding has been described above, but a 
switch 208 switches between inter-picture prediction de- 
coding and intra-picture prediction decoding. In a case 
of intra-picture decoding, a predicted image is not gen- 
erated by motion compensation, but a decoded image 
is generated by generating a predicted image of a cur- 
rent area to be decoded from a decoded area in the 
same picture and adding the predicted image. The de- 
coded image is stored in the picture memory 203, as is 
the case with the inter-picture prediction decoding, and 
outputted as a picture signal for display according to dis- 
play timing. 

(2) Processing of Converting Reference Indices 

[0075] The reference index/picture number conver- 
sion unit 206 assigns picture numbers and reference in- 
dices using the inputted maximum number of reference 
indices and commands for reference index assignment. 
They are assigned in exactly the same manner as the 
coding apparatus. In the present embodiment, the value 
obtained by doubling the maximum number of reference 
indices for frame coding is used as the maximum 
number of reference indices for field coding. Therefore, 
the assignment for frame coding as shown in Fig. 2 turns 
to be the assignment as shown in Fig. 4 for field coding. 
[0076] As described above, according to the coding 
apparatus and the decoding apparatus in the present 
embodiment, the maximum number of reference indices 
and the assignment commands for frame coding, if only 
they are coded in a bit stream, can be applied appropri- 
ately not only to frame coding but also to field coding in 
a case of MBAFF. Also, the value obtained by doubling 
the maximum number of reference indices for frame 
coding is used as the maximum number for field coding, 
all the fields stored in the memory can be used effec- 
tively for coding and decoding. 

(Second Embodiment) 

<Overview of Coding Apparatus and Decoding 
Apparatus> 

[0077] First, an overview of a coding apparatus and a 
decoding apparatus in the present embodiment will be 
explained. 

[0078] The coding apparatus and the decoding appa- 
ratus in the present embodiment perform MBAFF, and 
for that purpose, they handle the maximum number of 
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reference indices and a command sequence in the fol- 
lowing manners (2.1) and (2.2), respectively. 
[0079] (2.1) Since the maximum number of reference 
indices is same as (1.1) as described at the outset of 
the first embodiment, the explanation thereof is omitted. 5 
[0080] (2.2) As for the command sequence, the cod- 
ing apparatus describes commands for frame coding in 
a bit stream to be transmitted. As described using Fig. 
37 and Fig. 38, the coding apparatus assigns reference 
indices for frame coding for the purpose of frame coding. 10 
Note that correspondences of the reference indices are 
established in the manner of the default assignment, as 
described using Fig. 37, if the command sequence is 
not coded. 

[0081 ] Further, for the purpose of field coding, the as- 15 
signment of reference indices is updated based on the 
assigned reference indices for frame coding. 
[0082] In the present embodiment, differently from the 
first embodiment, regardless of whether a current mac- 
roblock to be coded is in a top field or a bottom field, the 20 
value obtained by doubling the value of reference index 
for frame coding is assigned to a top field out of two fields 
that make up one frame, while the value obtained by 
doubling the reference index for frame coding and add- 
ing 1 (x2+1) is assigned to a bottom field, respectively, 25 
as reference indices for field coding (See Fig. 9). 

<Structure of Coding Apparatus> 

[0083] Fig. 8 is a block diagram showing the structure 30 
of the coding apparatus in the second embodiment of 
the present invention. The coding apparatus in this fig- 
ure is different from that in Fig. 1 in that the former in- 
cludes a reference index/picture number conversion 
unit 1 09a, instead of the reference index/picture number 35 
conversion unit 1 09. The same points as those in Fig. 1 
are omitted, and the following explanation will focus on 
the different points. The reference index/picture number 
conversion unit 1 09a is different from Fig. 1 only in that 
the former establishes a mapping (assignment of refer- 40 
ence indices) of above-mentioned (2.2), not a mapping 
of (1.2). 

< Example of Assignment of Reference lndices> 

45 

[0084] Fig. 9 is an illustration showing correspond- 
ences of the first and second reference indices for field 
coding, updated from the first and second reference in- 
dices for frame coding as shown in Fig. 2, according to 
the above (2.1) and (2.2). As shown in Fig. 9, the map- 50 
ping executed by the reference index/picture number 
conversion unit 109a in the present embodiment is not 
separate assignment of reference indices for top field 
coding and bottom field coding, but common assign- 
ment for both top field coding and bottom field coding. 55 
[0085] In the present embodiment, when field coding 
and frame coding are mixed in one picture, the value 
obtained by doubling the maximum number of reference 



indices for frame coding is handled as the value for field 
coding, and thus the number of indices in Fig. 2 is "3", 
whereas the number of indices in Fig. 9 is "6". 

<Processing of Assigning Reference lndices> 

[0086] Fig. 10 is a flowchart showing the processing 
of assigning reference indices executed by the refer- 
ence index/picture number conversion unit in the coding 
apparatus. 

[0087] In Fig. 10, the same step numbers are as- 
signed to the same processing as that in Fig. 6, and the 
flowchart in Fig. 1 0 is different from that in Fig. 6 in that 
S26 and S31 ~S34 in Fig. 6 are deleted and S27 is ex- 
ecuted next to S23 in Fig. 10. Due to these differences, 
the number of reference indices obtained by doubling 
the number of the reference indices for frame coding is 
assigned as the reference indices for field coding, and 
further the reference indices for field coding are as- 
signed commonly for both top field coding and bottom 
field coding, as shown in Fig. 9. 

<Structure of Decoding Apparatus> 

[0088] Fig. 11 is a block diagram showing the struc- 
ture of the decoding apparatus in the second embodi- 
ment of the present invention. The decoding apparatus 
in Fig. 1 1 is different from that in Fig. 7 in that the former 
includes a reference index/picture number conversion 
unit 206a, instead of the reference index/picture number 
conversion unit 206. The reference index/picture 
number conversion unit 206a is different from Fig. 7 only 
in that the former converts the reference indices accord- 
ing to the mapping of (2.2), not the mapping of (1.2). 

<Processing of Converting Reference lndices> 

[0089] The reference index/picture number conver- 
sion unit 206a assigns picture numbers and reference 
indices using the inputted maximum number of refer- 
ence indices and the reference index assignment com- 
mands. They are assigned in exactly the same manner 
as the coding apparatus. In the present embodiment, 
the value obtained by doubling the value of the maxi- 
mum number of reference indices for frame coding is 
used as the maximum number of reference indices for 
field coding. Therefore, the assignment for frame coding 
as shown in Fig. 2 turns to be the assignment for field 
coding as shown in Fig. 9. 

(Third Embodiment) 

<Overview of Coding Apparatus and Decoding 
Apparatus> 

[0090] First, the overview of the coding apparatus and 
the decoding apparatus in the present embodiment will 
be explained. 
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[0091] The coding apparatus and the decoding appa- 
ratus in the present embodiment perform MBAFF, and 
for that purpose, they handle the maximum number of 
the reference indices and the command sequence in the 
following manners (3.1) and (3.2). 
[0092] (3. 1 ) As for the maximum number of the refer- 
ence indices, the coding apparatus describes the max- 
imum number of reference indices for frame coding in a 
bit stream to be transmitted when field coding and frame 
coding are mixed. The coding apparatus handles this 
maximum number of reference indices as the number 
of available reference indices in frame coding, and, in 
field coding, it also handles the number for frame coding 
as the number of reference indices for field coding. For 
example, if the maximum number of reference indices 
for frame coding is 3, the coding apparatus also handles 
the maximum number of reference indices for field cod- 
ing as 3. 

[0093] (3.2) As for the command sequence, since it is 
handled in the same manner as (1.2) as described at 
the outset of the first embodiment, the explanation 
thereof is omitted. However, the same value is used as 
the maximum number of reference indices given by (3. 1 ) 
for both frame coding and field coding, so only the same 
number of reference indices as that as shown in Fig. 2 
can be applied to field coding (See Fig. 1 3). 

<Structure of Coding Apparatus> 

[0094] Fig. 12 is a block diagram showing the struc- 
ture of the coding apparatus in the third embodiment of 
the present invention. The coding apparatus in this fig- 
ure is different from that in Fig. 1 in that the former in- 
cludes a reference index/picture number conversion 
unit 1 09b, instead of the reference index/picture number 
conversion unit 109. The reference index/picture 
number conversion unit 109b is different from that in Fig. 
1 only in that the former handles the number of reference 
indices according to (3.1), not to (1.1). 

<Example of Reference Index Assignment 

[0095] Fig. 13 is an illustration showing correspond- 
ences of the first and second reference indices for field 
coding, updated from the first and second reference in- 
dices for frame coding as shown in Fig. 2, according to 
the above (3.1) and (3.2). As shown in Fig. 13, the map- 
ping executed by the reference index/picture number 
conversion unit 109b in the present embodiment is sep- 
arate assignment of reference indices to top fields and 
bottom fields in the same manner as the first embodi- 
ment, but is different in that the maximum number of ref- 
erence indices for field coding is same as the maximum 
number of reference indices for frame coding. 

<Structure of Decoding Apparatus> 

[0096] Fig. 14 is a block diagram showing the struc- 



ture of the decoding apparatus in the third embodiment 
of the present invention. The decoding apparatus in Fig. 
14 is different from that in Fig. 7 in that the former in- 
cludes a reference index/picture number conversion 

5 unit 206b, instead of the reference index/picture number 
conversion unit 206. The reference index/picture 
number conversion unit 206b is different from Fig. 7 only 
in that the former performs the reference index conver- 
sion processing according to the maximum number de- 

10 scribed in (3.2), not the maximum number described in 
(1.1). 

(Fourth Embodiment) 

'5 <Overview of Coding Apparatus and Decoding 
Apparatus > 

[0097] First, an overview of the coding apparatus and 
the decoding apparatus in the present embodiment will 

20 be explained. 

[0098] The coding apparatus and the decoding appa- 
ratus in the present embodiment perform MBAFF, and 
for that purpose, they handle the maximum number of 
reference indices and the command sequence in the fol- 

25 lowing manners (4.1 ) and (4.2). 

[0099] (4.1) As for the maximum number of reference 
indices, since it is handled in the same manner as (3.1 ) 
as described at the outset of the third embodiment, the 
explanation thereof is omitted. 

30 [0100] (4.2) Since it is same as (2.2) as described at 
the outset of the second embodiment, the explanation 
thereof is omitted. However, the same value is used as 
the maximum number of reference indices given by (4.1) 
for both frame coding and field coding, so only the same 

35 number of reference indices as that as shown in Fig. 2 
can be applied for field coding (See Fig. 1 6). 

<Structure of Coding Apparatus> 

^0 [0101] Fig. 15 is a block diagram showing the struc- 
ture of the coding apparatus in the fourth embodiment 
of the present invention. The coding apparatus in this 
figure is different from that in Fig. 8 in that the former 
includes a reference index/picture number conversion 

45 unit 1 09c, instead of the reference index/picture number 
conversion unit 109a. The reference index/picture 
number conversion unit 1 09c is different from that in Fig. 
8 only in that the former handles the maximum number 
of reference indices according to (4.1), not to (2.1). 

50 

<Example of Reference Index Assignment 

[0102] Fig. 16 is an illustration showing correspond- 
ences of the first and second reference indices for field 
55 coding, updated from the first and second reference in- 
dices for frame coding as shown in Fig. 2, according to 
the above (4.1 ) and (4.2). As shown in Fig. 1 6, the map- 
ping executed by the reference index/picture number 
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conversion unit 109c in the present embodiment is as- 
signment of common reference indices for both top field 
coding and bottom field coding, in the same manner as 
the second embodiment, but is different in that the max- 
imum number of reference indices for field coding is 5 
same as the maximum number of reference indices for 
frame coding. 

<Structure of Decoding Apparatus> 

10 

[01 03] The decoding apparatus in the present embod- 
iment may be same as the decoding apparatus in the 
second embodiment. However, the former is different 
from the latter in that the former handles the maximum 
number of reference indices for field coding as the same 15 
number as the maximum number of reference indices 
for frame coding, not the doubled number. 

(Fifth Embodiment) 

20 

<Overview of Coding Apparatus and Decoding 
Apparatus> 

[01 04] First, the overview of the coding apparatus and 
the decoding apparatus in the present embodiment will 25 
be explained. 

[01 05] The coding apparatus and the decoding appa- 
ratus in the present embodiment perform MBAFF, and 
for that purpose, they handle the maximum number of 
the reference indices and the command sequence in the 30 
following manners (5.1) and (5.2). 
[0106] (5.1) As for the maximum number of reference 
indices, since it is handled in the same manner as (3.1 ) 
as described at the outset of the third embodiment, the 
explanation thereof is omitted. 35 
[0107] (5.2) As for the command sequence, the cod- 
ing apparatus describes commands for frame coding in 
a bit stream to be transmitted. As described using Fig. 
37 and Fig. 38, the coding apparatus assigns reference 
indices for frame coding for the purpose of frame coding. 40 
Note that correspondences of the reference indices are 
established by the default assignment method, as de- 
scribed using Fig. 37, if the command sequence is not 
coded. 

[0108] Further, for the purpose of field coding, the as- 45 
signment of reference indices is updated based on the 
assigned reference indices for frame coding. 
[0109] In the present embodiment, differently from the 
first embodiment, the value of reference index for frame 
coding is assigned to a field of the same parity as that so 
of a current macroblock to be coded, out of two fields 
that make up one frame, as a reference index for field 
coding, while no value is assigned to a field of the op- 
posite parity (See Fig. 1 8). 

[0110] In other words, when the current macroblock 55 
belongs to the top field, the value of the reference index 
for frame coding is assigned to the top field out of the 
above two fields, as a reference index for field coding. 
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When the current macroblock belongs to the bottom 
field, the value of the reference index for frame coding 
is assigned to the bottom field out of the above two 
fields, as a reference index for field coding. 
[0111] On the other hand, the decoding apparatus de- 
codes the maximum number of reference indices for 
frame coding and the assignment commands included 
in the transmitted bit stream, and using them, it assigns 
the reference pictures and the reference indices in ex- 
actly the same manner as the coding apparatus. 

<Structure of Coding Apparatus> 

[0112] Fig. 17 is a block diagram showing the struc- 
ture of the coding apparatus in the fifth embodiment of 
the present invention. The coding apparatus in this fig- 
ure is different from that in Fig. 1 , in order to adapt to 
the above (5.1) and (5.2), in that the former includes a 
reference index/picture number conversion unit 109d, 
instead of the reference index/picture number conver- 
sion unit 109. 

<Example of Reference Index Assignment 

[0113] Fig. 18 is an illustration showing correspond- 
ences of the first and second reference indices for field 
coding, updated from the first and second reference in- 
dices for frame coding as shown in Fig. 2, according to 
the above (5.1 ) and (5.2). As shown in Fig. 1 8, the value 
of the reference index for frame coding is applied to a 
field of the same parity as a current macroblock as the 
reference index for field coding, while no index is applied 
to a field of the opposite parity. 

<Processing of Assigning Reference lndices> 

[0114] Fig. 19 is a flowchart showing the processing 
of assigning reference indices executed by the refer- 
ence index/picture number conversion unit in the coding 
apparatus. Fig. 19 is different from Fig. 6 in that S81 is 
added instead of S27-S30 and S82 is added instead of 
S31-S34. 

<Structure of Decoding Apparatus> 

[0115] Fig. 20 is a block diagram showing the struc- 
ture of the decoding apparatus in the fifth embodiment 
of the present invention. The decoding apparatus in Fig. 
20 is different from that in Fig. 7 in that the former in- 
cludes a reference index/picture number conversion 
unit 206d, instead of the reference index/picture number 
conversion unit 206. 

[0116] According to the same operation as the map- 
ping of (5.2), the reference index/picture number con- 
version unit 206b executes a mapping of indices for field 
coding for top fields only if a current macroblock to be 
decoded is in a top field and for bottom fields only if a 
current macroblock is in a bottom field, respectively. 
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(Sixth Embodiment) 

<Overview of Coding Apparatus and Decoding 
Apparatus> 

5 

[01 1 7] First, the overview of the coding apparatus and 
the decoding apparatus in the present embodiment will 
be explained. 

[01 1 8] The coding apparatus and the decoding appa- 
ratus in the present embodiment perform MBAFF, and 10 
for that purpose, they handle the maximum number of 
the reference indices and the command sequence in the 
following manners (6.1) and (6.2). Here, the reference 
indices and the commands are same as those as shown 
in Fig. 37, and the maximum number of the reference '5 
indices is same as that as shown in Fig. 39. 
[0119] (6.1) As for the maximum number of reference 
indices, when both field coding and frame coding are 
mixed, the coding apparatus describes not only the 
maximum number of reference indices for frame coding 20 
but also the maximum number of reference indices for 
top field coding and the maximum number of reference 
indices for bottom field coding, respectively, in a bit 
stream to be transmitted. 

[0120] The decoding apparatus uses the maximum 25 
number of reference indices for top field coding and the 
maximum number of reference indices for bottom field 
coding described in the bit stream. 
[01 21 ] (6.2) As for the command sequence, since it is 
same as that in (1 .2), the explanation thereof is omitted. 30 
However, the reference indices for top field coding are 
handled so as not to exceed the maximum number de- 
scribed in the bit stream. The same applies to the refer- 
ence indices for bottom field coding. 

[01 22] On the other hand, the decoding apparatus de- 35 
codes the maximum numbers of the reference indices 
forframe coding, top field coding and bottom field coding 
and the assignment commands, which are included in 
the transmitted bit stream, and using them, it assigns 
the reference pictures and the reference indices in ex- 40 
actly the same manner as the coding apparatus. 

<Structure of Coding Apparatus and Decoding 
Apparatus> 

45 

[01 23] The coding apparatus and the decoding appa- 
ratus in the present embodiment may be same as the 
coding apparatus and the decoding apparatus in the first 
embodiment. However, as the maximum number of ref- 
erence indices for top field coding and the maximum so 
number of reference indices for bottom field coding, they 
use the values described in the bit stream, not the values 
obtained by doubling the values of reference indices for 
frame coding. 

55 

<Data Structure> 

[0124] Fig. 21 is a diagram showing the data structure 



of the bit stream in the sixth embodiment of the present 
invention. In this figure, the first reference picture refl 
corresponds to Max_idx1 included in the picture com- 
mon information, and the maximum number of refer- 
ence indices for frame coding (Max_idx_frm), the max- 
imum number of reference indices for top field coding 
(Max_idx_Jop) and the maximum number of reference 
indices for bottom field coding (Max_idx_btm) are de- 
scribed in Maxjdxl. 

[0125] Fig. 22 is an illustration showing an example 
of assigning the first and second reference indices to 
picture numbers of fields in a case of field coding. In this 
figure, "5" is described in Max_idx_top, while "6" is de- 
scribed in Max_idx_btm. In this way, the coding appa- 
ratus and the decoding apparatus in the present embod- 
iment can set the maximum number of reference fields 
flexibly for top fields and bottom fields. 
[0126] Note that the maximum number of reference 
indices for top field coding and the maximum number of 
reference indices for bottom field coding are described 
in a bit stream separately (See (6.1)), but one maximum 
number common to both top and bottom field coding 
may be described instead. 

[01 27] In (6.2), as in the case with (1 .2), the value ob- 
tained by doubling the value of the reference index for 
frame coding is assigned to a field of the same parity as 
a current microblock to be coded, out of two fields that 
make up one reference frame specified by the reference 
index and the command for the frame, whereas the val- 
ue obtained by doubling the value of that reference in- 
dex for frame coding and adding 1 (x2-M ) is assigned 
to another field of the opposite parity to the current mi- 
croblock, respectively, as reference indices for field cod- 
ing (See Fig. 4). Instead, as in the case with (2.2), the 
value obtained by doubling the value of the reference 
index for frame coding may be assigned to a top field, 
out of two fields that make up one reference frame spec- 
ified by the reference index and the command for the 
frame, and the value obtained by doubling the value of 
that reference index for frame coding and adding 1 
(x2+1) may be assigned to a bottom field, respectively, 
as reference indices for field coding (See Fig. 9). 

(Seventh Embodiment) 

<Overview of Coding Apparatus and Decoding 
Apparatus> 

[01 28] First, the overview of the coding apparatus and 
the decoding apparatus in the present embodiment will 
be explained. 

[01 29] The coding apparatus and the decoding appa- 
ratus in the present embodiment perform MBAFF, and 
for that purpose, they handle the maximum number of 
the reference indices and the command sequence in the 
following manners (7.1) and (7.2). Here, the reference 
indices and the commands are same as those as shown 
in Fig. 37, and the maximum number of the reference 
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indices is same as that as shown in Fig. 39. 
[0130] (7.1) As for the maximum number of reference 
indices, since it is handled in exactly the same manner 
as (6.1), the explanation thereof is omitted. 
[0131] (7.2) As for the command sequence, the cod- 
ing apparatus describes not only the reference indices 
and the commands for frame coding but also the refer- 
ence indices and the commands for top field coding and 
the reference indices and the commands for bottom field 
coding in a bit stream to be transmitted. The coding ap- 
paratus assigns the reference indices for frame coding 
for the purpose of frame coding, while it assigns the ref- 
erence indices for top field coding and the reference in- 
dices for bottom field coding forthe purpose of field cod- 
ing. 

[01 32] On the other hand, the decoding apparatus de- 
codes the maximum number of reference indices and 
the assignment commands for frame coding, top field 
coding and bottom field coding, included in the transmit- 
ted bit stream, and using them, it assigns the reference 
pictures and the reference indices in exactly the same 
manner as the coding apparatus. 

(Structure of Coding Apparatus) 

[0133] Fig. 23 is a block diagram showing the struc- 
ture of the coding apparatus in the seventh embodiment 
of the present invention. The coding apparatus in this 
figure is different from that in Fig. 1 in that the former 
includes a reference index/picture number conversion 
unit 1 09e, instead of the reference index/picture number 
conversion unit 109. 

[0134] Fig. 24 is a diagram showing an example of a 
data structure of a bit stream in the present embodiment. 
In this figure, idx_cmd1 is a set of commands forthe first 
reference picture refl, and includes idx_cmd_frm, 
idx_cmd_top and idx_cmd_btm. idx_cmd_frm is a com- 
mand sequence for reference indices for frame coding. 
idx_cmd_top is a command sequence for reference in- 
dices for top field coding. idx_cmd_btm is a command 
sequence for reference indices for bottom field coding. 
[0135] Fig. 25 is an illustration showing an example 
of assigning the first and second indices to picture num- 
bers of fields in a case of field coding. In this figure, the 
reference indices for top field coding and the reference 
indices for bottom field coding can be independently as- 
signed to arbitrary fields. 

[0136] Fig. 26 is a diagram showing an example of 
correspondences between reference indices, com- 
mands and picture numbers of fields in a case of Fig. 25. 
[0137] Fig. 27 is a flowchart showing the processing 
of assigning reference indices and commands executed 
by the reference index/picture number conversion unit 
109e. As shown in this figure, the reference index/pic- 
ture number conversion unit 109e assigns reference in- 
dices and commands for frame coding (S11), and when 
frame coding and field coding are mixed (S12), it as- 
signs reference indices and commands fortop field cod- 



ing (S93) and further assigns reference indices and 
commands for bottom field coding (S94). 
[0138] Note that in Fig. 27, no command is assigned 
in S11 , S93 and S94 when default reference indices are 
5 used. 

<Structure of Decoding Apparatus> 

[0139] Fig. 28 is a block diagram showing the struc- 
io ture of the decoding apparatus in the seventh embodi- 
ment of the present invention. Fig. 28 includes a refer- 
ence index/picture number conversion unit206e instead 
of the reference index/picture number conversion unit 
206 in Fig. 7. The reference index/picture number con- 
's version unit 206e establishes correspondences be- 
tween picture numbers and reference indices for frame 
coding, top field coding and bottom field coding, respec- 
tively, using index assignment commands for them in- 
putted from the bit stream analysis unit 201 . 
20 [0140] In the present embodiment, command se- 
quences for top field coding and bottom field coding are 
described separately in a bit stream, but they may be 
one common command sequence. Fig. 29 is a diagram 
showing the data structure of the bit stream in that case. 
25 in this figure, idx_fld is a command sequence common 
to top field coding and bottom field coding. 
[0141] Note that the maximum number of reference 
indices for field coding as described in (7. 1 ) do not have 
to be specific to top field coding or bottom field coding, 
30 but may be common to top field coding and bottom field 
coding. 

[01 42] Also, the reference indices and commands for 
field coding as described in (7.2) do not have to be spe- 
cific to top field coding or bottom field coding, and may 

35 be common to top field coding and bottom field coding. 
[0143] Also, the decoding apparatus in each of the 
above embodiments may create a reference table be- 
tween reference indices for field coding and picture 
numbers of fields before starting decoding of a slice, and 

40 refer to the table when decoding a field-coded macrob- 
lock. 

(Eighth Embodiment) 

45 [0144] If a program for realizing the structures of the 
picture coding method or the picture decoding method 
as shown in each of the above embodiments is recorded 
on a memory medium such as a flexible disk, it becomes 
possible to perform the processing as shown in each of 

50 the embodiments easily in an independent computer 
system. 

[01 45] Figs. 30A, 30B and 30C are illustrations show- 
ing the case where the present invention is implemented 
in a computer system using a flexible disk which stores 
55 the picture coding method or the picture decoding meth- 
od of the above first to seventh embodiments. 
[0146] Fig. 30B shows a front view and a cross-sec- 
tional view of an appearance of a flexible disk, and the 
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flexible disk itself, and Fig. 30A shows an example of a 
physical format of a flexible disk as a recording medium 
body. The flexible disk FD is contained in a case F, and 
a plurality of tracks Tr are formed concentrically on the 
surface of the disk in the radius direction from the pe- 
riphery and each track is divided into 16 sectors Se in 
the angular direction. Therefore, as for the flexible disk 
storing the above-mentioned program, the picture cod- 
ing method as the program is recorded in an area allo- 
cated for it on the flexible disk FD. 
[0147] Fig. 30C shows the structure for recording and 
reproducing the program on and from the flexible disk 
FD. When the program is recorded on the flexible disk 
FD, the picture coding method or the picture decoding 
method as a program is written in the flexible disk from 
the computer system Cs via a flexible disk drive. When 
the picture coding method is constructed in the compu- 
ter system by the program on the flexible disk, the pro- 
gram is read out from the flexible disk using the flexible 
disk drive and transferred to the computer system. 
[0148] The above explanation is made on the as- 
sumption that a recording medium is a flexible disk, but 
the same processing can also be performed using an 
optical disk. In addition, the recording medium is not lim- 
ited to a flexible disk and an optical disk, but any other 
medium such as an IC card and a ROM cassette capa- 
ble of recording a program can be used. 

(Ninth Embodiment) 

[0149] Fig. 31 to Fig. 34 are illustrations of devices for 
performing the coding processing or the decoding 
processing as described in the above embodiments and 
a system using them. 

[0150] Fig. 31 is a block diagram showing the overall 
configuration of a content supply system ex100 for re- 
alizing content distribution service. The area for provid- 
ing communication service is divided into cells of de- 
sired size, and base stations ex1 07 to ex1 1 0 which are 
fixed wireless stations are placed in respective cells. 
[0151] In this content supply system ex100, devices 
such as a computer ex111 , a PDA (personal digital as- 
sistant) ex1 1 2, a camera ex1 1 3, a mobile phone ex1 1 4 
and a camera-equipped mobile phone ex115 are con- 
nected to the Internet ex 1 01 via an Internet service pro- 
vider ex102, a telephone network ex104 and base sta- 
tions ex107 to ex110. 

[0152] However, the content supply system ex100 is 
not limited to the configuration as shown in Fig. 31 , and 
a combination of any of them may be connected. Also, 
each device may be connected directly to the telephone 
network ex104, not through the base stations ex107 to 
ex110. 

[01 53] The camera ex1 1 3 is a device such as a digital 
video camera capable of shooting moving pictures. The 
mobile phone may be a mobile phone of a PDC (Per- 
sonal Digital Communications) system, a CDMA (Code 
Division Multiple Access) system, a W-CDMA (Wide- 
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band-Code Division Multiple Access) system or a GSM 
(Global System for Mobile Communications) system, a 
PHS (Personal Handyphone system) or the like. 
[01 54] A streaming server ex1 03 is connected to the 
5 camera ex113 via the base station ex1 09 and the tele- 
phone network ex104, which allows live distribution or 
the like using the camera ex1 1 3 based on the coded da- 
ta transmitted from a user. Either the camera ex1 13 or 
the server for transmitting the data may code the shot 

io data. Also, the moving picture data shot by a camera 
ex1 1 6 may be transmitted to the streaming server ex1 03 
via the computer ex1 11 . The camera ex1 1 6 is a device 
such as a digital camera capable of shooting still and 
moving pictures. Either the camera ex116 or the com- 

15 puter ex1 11 may code the moving picture data. An LSI 
ex117 included in the computer ex111 or the camera 
ex116 actually performs coding processing. Software 
for coding and decoding moving pictures may be inte- 
grated into any type of storage medium (such as a 

20 CD-ROM, a flexible disk and a hard disk) that is a re- 
cording medium which is readable by the computer 
ex111 or the like. Furthermore, the camera-equipped 
mobile phone ex115 may transmit the moving picture 
data. This moving picture data is the data coded by the 

25 LSI included in the mobile phone ex115. 

[01 55] The content supply system ex1 00 codes con- 
tents (such as a live music video) shot by users using 
the camera ex113, the camera ex116 or the like in the 
same manner as the above embodiment and transmits 

30 them to the streaming server ex1 03, while the streaming 
server ex103 makes stream distribution of the content 
data to the clients at their request. The clients include 
the computer ex1 1 1 , the PDA ex1 1 2, the camera ex1 1 3, 
the mobile phone ex1 1 4 and so on capable of decoding 

35 the above-mentioned coded data. In the content supply 
system ex100, the clients can thus receive and repro- 
duce the coded data, and further the clients can receive, 
decode and reproduce the data in real time so as to re- 
alize personal broadcasting. 

40 [0156] When each device in this system performs 
coding or decoding, the moving picture coding appara- 
tus orthe moving picture decoding apparatus, as shown 
in each of the above-mentioned embodiments, can be 
used. 

45 [0157] A mobile phone will be explained as an exam- 
ple of the device. 

[0158] Fig. 32 is a diagram showing the mobile phone 
ex115 that uses the moving picture coding method and 
the moving picture decoding method explained in the 

50 above embodiments. The mobile phone ex115 has an 
antenna ex201 for sending and receiving radio waves 
to and from the base station ex 1 1 0, a camera unit ex203 
such as a CCD camera capable of shooting video and 
still pictures, a display unit ex202 such as a liquid crystal 

55 display for displaying the data obtained by decoding vid- 
eo and the like shot by the camera unit ex203 and re- 
ceived via the antenna ex201 , a body unit including a 
set of operation keys ex204, a voice output unit ex208 
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such as a speaker for outputting voices, a voice input 
unit 205 such as a microphone for inputting voices, a 
storage medium ex207 for storing coded or decoded da- 
ta such as data of moving or still pictures shot by the 
camera, and text data and data of moving or still pictures 
of received e-mails, and a slot unit ex206 for attaching 
the storage medium ex207 to the mobile phone ex115. 
The storage medium ex207 includes a flash memory el- 
ement, a kind of EEPROM (Electrically Erasable and 
Programmable Read Only Memory) that is an electrical- 
ly erasable and rewritable nonvolatile memory, in a plas- 
tic case such as an SD card. 

[0159] The mobile phone ex115 will be further ex- 
plained with reference to Fig. 33. In the mobile phone 
ex115, a main control unit ex311 for overall controlling 
the display unit ex202 and the body unit including oper- 
ation keys ex204 is connected to a power supply circuit 
unit ex310, an operation input control unit ex304, a pic- 
ture coding unit ex312, a camera interface unit ex303, 
an LCD (Liquid Crystal Display) control unit ex302, a pic- 
ture decoding unit ex309, a multiplex/demultiplex unit 
ex308, a record/reproduce unit ex307, a modem circuit 
unit ex306 and a voice processing unit ex305, and they 
are connected to each other via a synchronous bus 
ex313. 

[0160] When a call-end key or a power key is turned 
ON by a user's operation, the power supply circuit unit 
ex310 supplies respective units with power from a bat- 
tery pack so as to activate the camera-equipped digital 
mobile phone ex115 for making it into a ready state. 
[01 61 ] In the mobile phone ex1 1 5, the voice process- 
ing unit ex305 converts the voice signals received by 
the voice input unitex205 in conversation mode into dig- 
ital voice data under the control of the main control unit 
ex311 including a CPU, ROM and RAM, the modem cir- 
cuit unit ex306 performs spread spectrum processing of 
the digital voice data, and the send/receive circuit unit 
ex301 performs digital-to-analog conversion and fre- 
quency transform of the data, so as to transmit it via the 
antenna ex201 . Also, in the mobile phone ex115, after 
the data received by the antenna ex201 in conversation 
mode is amplified and performed of frequency transform 
and analog-to-digital conversion, the modem circuit unit 
ex306 performs inverse spread spectrum processing of 
the data, and the voice processing unit ex305 converts 
it into analog voice data, so as to output it via the voice 
output unit 208. 

[0162] Furthermore, when transmitting e-mail in data 
communication mode, the text data of the e-mail input- 
ted by operating the operation keys ex204 on the body 
unit is sent out to the main control unit ex311 via the 
operation input control unit ex304. In the main control 
unit ex311 , after the modem circuit unit ex306 performs 
spread spectrum processing of the text data and the 
send/receive circuit unit ex301 performs digital-to-ana- 
log conversion and frequency transform for it, the data 
is transmitted to the base station ex110 via the antenna 
ex201 . 



30 

[0163] When picture data is transmitted in data com- 
munication mode, the picture data shot by the camera 
unit ex203 is supplied to the picture coding unit ex312 
via the camera interface unit ex303. When the picture 

5 data is not transmitted, it is also possible to display the 
picture data shot by the camera unit ex203 directly on 
the display unit 202 via the camera interface unit ex303 
and the LCD control unit ex302. 
[0164] The picture coding unit ex312, which includes 

w the picture coding apparatus as explained in the present 
invention, compresses and codes the picture data sup- 
plied from the camera unit ex203 by the coding method 
used for the picture coding apparatus as shown in the 
above embodiments so as to transform it into coded pic- 

15 ture data, and sends it out to the multiplex/demultiplex 
unit ex308. At this time, the mobile phone ex115 sends 
out the voices received by the voice input unit ex205 
during shooting by the camera unit ex203 to the multi- 
plex/demultiplex unit ex308 as digital voice data via the 

20 voice processing unit ex305. 

[0165] The multiplex/demultiplex unit ex308 multi- 
plexes the coded picture data supplied from the picture 
coding unit ex312 and the voice data supplied from the 
voice processing unit ex305 by a predetermined metri- 
cs od, the modem circuit unit ex306 performs spread spec- 
trum processing of the multiplexed data obtained as a 
result of the multiplexing, and the send/receive circuit 
unit ex301 performs digital-to-analog conversion and 
frequency transform of the data for transmitting via the 

30 antenna ex201 . 

[0166] As for receiving data of a moving picture file 
which is linked to a Web page or the like in data com- 
munication mode, the modem circuit unit ex306 per- 
forms inverse spread spectrum processing of the signal 

35 received from the base station ex110 via the antenna 
ex201 , and sends out the multiplexed data obtained as 
a result of the processing to the multiplex/demultiplex 
unit ex308. 

[0167] In order to decode the multiplexed data re- 
40 ceived via the antenna ex201 , the multiplex/demultiplex 
unit ex308 separates the multiplexed data into a bit 
stream of picture data and a bit stream of voice data, 
and supplies the coded picture data to the picture de- 
coding unit ex309 and the voice data to the voice 
45 processing unit ex305 respectively via the synchronous 
bus ex313. 

[0168] Next, the picture decoding unit ex309, which 
includes the picture decoding apparatus as explained in 
the present invention, decodes the bit stream of picture 
50 data by the decoding method corresponding to the cod- 
ing method as shown in the above-mentioned embodi- 
ments to generate reproduced moving picture data, and 
supplies this data to the display unit ex202 via the LCD 
control unit ex302, and thus moving picture data includ- 
es ed in a moving picture file linked to a Web page, for in- 
stance, is displayed. At the same time, the voice 
processing unit ex305 converts the voice data into an- 
alog voice data, and supplies this data to the voice out- 
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put unit ex208, and thus voice data included in a moving 
picture file linked to a Web page, for instance, is repro- 
duced. 

[0169] The present invention is not limited to the 
above-mentioned system, and at least either the picture 5 
coding apparatus or the picture decoding apparatus in 
the above-mentioned embodiments can be incorporat- 
ed into a system for digital broadcasting as shown in 
Fig. 34. Such ground-based or satellite digital broad- 
casting has been in the news lately. More specifically, a io 
coded bit stream of video information is transmitted from 
a broadcast station ex409 to a communication or broad- 
cast satellite ex410 via radio waves. Upon receipt of it, 
the broadcast satellite ex410 transmits radio waves for 
broadcasting, a home-use antenna ex406 with a satel- 15 
lite broadcast reception function receives the radio 
waves, and a television (receiver) ex401 or a set top box 
(STB) ex407 decodes the bit stream for reproduction. 
The picture decoding apparatus as shown in the above- 
mentioned embodiments can be implemented in the re- 20 
production apparatus ex403 for reading off and decod- 
ing the bit stream recorded on a storage medium ex402 
that is a recording medium such as a CD and DVD. In 
this case, the reproduced video signals are displayed 
on a monitor ex404. It is also conceived to implement 25 
the picture decoding apparatus in the set top box ex407 
connected to a cable ex405 for a cable television or the 
antenna ex406 for satellite and/or ground-based broad- 
casting so as to reproduce them on a monitor ex408 of 
the television ex401 . The picture decoding apparatus 30 
may be incorporated into the television, not in the set 
top box. Or, a car ex412 having an antenna ex411 can 
receive signals from the satellite ex41 0, the base station 
ex107 or the like for reproducing moving pictures on a 
display device such as a car navigation system ex413 35 
in the car ex412. 

[0170] Furthermore, the picture coding apparatus as 
shown in the above-mentioned embodiments can code 
picture signals for recording on a recording medium. As 
a concrete example, there is a recorder ex420 such as 40 
a DVD recorder for recording picture signals on a DVD 
disc ex421 and a disk recorder for recording them on a 
hard disk. They can be recorded on an SD card ex422. 
If the recorder ex420 includes the picture decoding ap- 
paratus as shown in the above-mentioned embodi- 45 
ments, the picture signals recorded on the DVD disc 
ex421 or the SD card ex422 can be reproduced for dis- 
play on the monitor ex408. 

[0171] As the structure of the car navigation system 
ex41 3, the structure without the camera unit ex203, the so 
camera interface unit ex303 and the picture coding unit 
ex312, out of the units shown in Fig. 33, is conceivable. 
The same applies to the computer ex1 1 1 , the television 
(receiver) ex401 and others. 

[0172] In addition, three types of implementations can 55 
be conceived for a terminal such as the above-men- 
tioned mobile phone ex114; a sending/receiving termi- 
nal including both an encoder and a decoder, a sending 



terminal including an encoder only, and a receiving ter- 
minal including a decoder only. 

[0173] As described above, it is possible to use the 
moving picture coding method or the moving picture de- 
coding method in the above-mentioned embodiments in 
any of the above-mentioned apparatuses and systems, 
and using this method, the effects described in the 
above embodiments can be obtained. 
[01 74] It should be noted that the present invention is 
not limited to the above embodiments, and many varia- 
tions or modifications thereof are possible without de- 
parting from the scope of the invention. 

Industrial Applicability 

[0175] The present invention is suitable for a picture 
coding apparatus for performing coding with switching 
between frame coding and field coding on a block-by- 
block basis in a picture and a picture decoding appara- 
tus. More specifically, it is suitable for a Web server for 
distributing moving pictures, a network terminal for re- 
ceiving them, a digital camera for recording and replay- 
ing moving pictures, a camera-equipped mobile phone, 
a DVD recorder/player, a PDA, a personal computer and 
the like. 



Claims 

1 . A moving picture coding method for coding a picture 
with switching between frame coding and field cod- 
ing adaptively on a block-by-block basis, compris- 
ing an assignment step of assigning field reference 
indices to fields using frame reference indices, the 
field reference indices specifying fields which are 
referred to at the time of field coding, and the frame 
reference indices specifying frames which are re- 
ferred to at the time of frame coding. 

2. The moving picture coding method according to 
Claim 1, further comprising a specification step of 
specifying two fields that make up each of the 
frames specified by each of the frame reference in- 
dices, 

wherein in the assignment step, a first value 
is assigned to one field having a parity same as a 
parity of afield including a current block to be coded, 
out of the specified two fields, as each of the field 
reference indices, the first value being obtained by 
doubling a value of said each of the frame reference 
indices, and a second value is assigned to another 
field having a parity different from a parity of the field 
including the current block as said each of the field 
reference indices, the second value being obtained 
by adding one to said first value. 

3. The moving picture coding method according to 
Claim 2, further comprising a determination step of 
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determining a maximum number of the field refer- 
ence indices to be a value obtained by doubling a 
maximum number of the frame reference indices, 

wherein in the assignment step, the field ref- 
erence indices are assigned within a range of the 5 
determined maximum number. 

The moving picture coding method according to 
Claim 1 , further comprising a specification step of 
specifying two fields that make up each of the 10 
frames specified by each of the frame reference in- 
dices, the two fields being a top field and a bottom 
field, 

wherein in the assignment step, a first value 
is assigned to the top field, out of the specified two 1$ 
fields, as each of the field reference indices, the first 
value being obtained by doubling a value of said 
each of the frame reference indices, and a second 
value is assigned to the bottom field as said each 
of the field reference indices, the second value be- 20 
ing obtained by adding one to said first value. 

The moving picture coding method according to 
Claim 1 , further comprising a specification step of 
specifying two fields that make up each of the 25 
frames specified by each of the frame reference in- 
dices, 

wherein in the assignment step, a value same 
as a value of said each of the frame reference indi- 
ces is assigned only to one field having a parity 30 
same as a parity of a field including a current block 
to be coded, out of the specified two fields, as each 
of the field reference indices. 

The moving picture coding method according to 35 
Claim 1 , further comprising an addition step of gen- 
erating a command sequence indicating how to as- 
sign the frame reference indices and a command 
sequence indicating how to assign the field refer- 
ence indices independently, coding said two com- 40 
mand sequences, and adding said coded command 
sequences to a coded signal. 

The moving picture coding method according to 
Claim 1 , 45 

wherein the field reference indices consist of 
top field reference indices and bottom field refer- 
ence indices, and 

said moving picture coding method further 
comprises an addition step of generating a com- so 
mand sequence indicating how to assign the frame 
reference indices, a command sequence indicating 
how to assign the top field reference indices and a 
command sequence indicating how to assign the 
bottom field reference indices independently, cod- 55 
ing said three command sequences, and adding 
said coded command sequences to a coded signal. 



8. The moving picture coding method according to 
Claim 1 , further comprising a determination step of 
determining a maximum number of the field refer- 
ence indices, 

wherein in the assignment step, the field ref- 
erence indices are assigned to fields within a range 
of the determined maximum number using the 
frame reference indices. 

9. The moving picture coding method according to 
Claim 8, 

wherein in the determination step, the maxi- 
mum number of the field reference indices is deter- 
mined to be a value obtained by doubling a maxi- 
mum number of the frame reference indices. 

10. The moving picture coding method according to 
Claim 8, 

wherein in the determination step, the maxi- 
mum number of the field reference indices is deter- 
mined to be a value same as a maximum number 
of the frame reference indices. 

11. The moving picture coding method according to 
Claim 8, further comprising an addition step of de- 
termining a maximum number of the frame refer- 
ence indices independently of the maximum 
number of the field reference indices, coding said 
two maximum numbers, and adding said coded 
maximum numbers to a coded signal. 

12. The moving picture coding method according to 
Claim 8, 

wherein the field reference indices consist of 
top field reference indices and bottom field refer- 
ence indices, and 

said moving picture coding method further 
comprises an addition step of determining a maxi- 
mum number of the frame reference indices, a max- 
imum number of the top field reference indices and 
a maximum number of the bottom field reference 
indices independently, coding said three maximum 
numbers, and adding said coded maximum num- 
bers to a coded signal. 

13. A moving picture decoding method for decoding a 
picture with switching between frame decoding and 
field decoding adaptively on a block-by-block basis, 
comprising an assignment step of assigning field 
reference indices to fields using frame reference in- 
dices, the field reference indices specifying fields 
which are referred to at the time of field decoding, 
and the frame reference indices specifying frames 
which are referred to at the time of frame decoding. 

14. The moving picture decoding methodaccording to 
Claim 13, further comprising a specification step of 
specifying two fields that make up each of the 



18 



35 



EP 1 569 459 A1 



36 



assigned according to said two decoded command 
sequences. 

The moving picture decoding method according to 
Claim 13, 

wherein the field reference indices consist of 
top field reference indices and bottom field refer- 
ence indices, 

said moving picture decoding method further 
comprises: 



15. The moving picture decoding method according to 
Claim 14, further comprising a determination step 
of determining a maximum number of the field ref- 
erence indices to be a value obtained by doubling 
a maximum number of the frame reference indices, 

wherein in the assignment step, the field ref- 
erence Indices are assigned within a range of the 
determined maximum number. 

16. The moving picture decoding method according to 
Claim 13, further comprising a specification step of 
specifying two fields that make up each of the 
frames specified by each of the frame reference in- 
dices, the two fields being a top field and a bottom 
field, 

wherein in the assignment step, a first value 
is assigned to the top field, out of the specified two 
fields, as each of the field reference indices, the first 
value being obtained by doubling a value of said 
each of the frame reference indices, and a second 
value is assigned to the bottom field as said each 35 
of the field reference indices, the second value be- 
ing obtained by adding one to said first value. 

17. The moving picture decoding method according to 
Claim 1 3, further comprising a specification step of 40 
specifying two fields that make up each of the 
frames specified by each of the frame reference in- 
dices, 

wherein in the assignment step, a value same 
as a value of said each of the frame reference indi- 
ces is assigned only to one field having a parity 
same as a parity of a field including a current block 
to be decoded, out of the specified two fields, as 
each of the field reference indices. 

50 

18. The moving picture decoding method according to 
Claim 13, further comprising a command sequence 
decoding step of decoding a coded signal including 
a command sequence indicating how to assign the 
frame reference indices and a command sequence 55 
indicating how to assign the field reference indices, 

wherein in the assignment step, the frame ref- 
erence indices and the field reference indices are 



a command sequence decoding step of decod- 
ing a coded signal including a command se- 
quence indicating how to assign the frame ref- 
erence indices, a command sequence indicat- 
ing how to assign the top field reference indices 
and a command sequence indicating howto as- 
sign the bottom field reference indices, and 
in the assignment step, the frame reference in- 
dices, the top field reference indices and the 
bottom field reference indices are assigned ac- 
cording to said three decoded command se- 
quences. 

20. The moving picture decoding method according to 
Claim 13, further comprising a determination step 
of determining a maximum number of the field ref- 
erence indices, 

wherein in the assignment step, the field ref- 
erence indices are assigned to fields within a range 
of the determined maximum number using the 
frame reference indices. 

21 . The moving picture decoding method according to 
Claim 20, 

wherein in the determination step, the maxi- 
mum number of the field reference indices is deter- 
mined to be a value obtained by doubling a maxi- 
mum number of the frame reference indices. 

22. The moving picture decoding method according to 
Claim 20, 

wherein in the determination step, the maxi- 
mum number of the field reference indices is deter- 
mined to be a value same as a maximum number 
of the frame reference indices. 

23. The moving picture decoding method according to 
Claim 20, 

wherein in the determination step, a maxi- 
mum number of the frame reference indices and the 
maximum number of the field reference indices are 
determined by decoding a coded signal including 
said two maximum numbers. 

24. The moving picture decoding method according to 
Claim 20, 

wherein the field reference indices consist of 



frames specified by each of the frame reference in- 
dices, 

wherein in the assignment step, a first value 
is assigned to one field having a parity same as a 19. 
parity of a field including a current block to be de- 5 
coded, out of the specified two fields, as each of the 
field reference indices, the first value being ob- 
tained by doubling a value of said each of the frame 
reference indices, and a second value is assigned 
to anotherf ield having a parity different from a parity 10 
of the field including the current block as said each 
of the field reference indices, the second value be- 
ing obtained by adding one to said first value. 
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top field reference indices and bottom field refer- decoding, 
ence indices, and 

in the determination step, a maximum number 
of the frame reference indices, a maximum number 
of the top field reference indices and a maximum 5 
number of the bottom field reference indices are de- 
termined by decoding a coded signal including said 
three maximum numbers. 



25. A moving picture coding apparatus for performing io 
coding with switching between frame coding and 
field coding adaptively on a block-by-block basis in 

a picture, comprising an assignment unit operable 
to assign field reference indices to fields using 
frame reference indices, the field reference indices 1$ 
specifying fields which are referred to at the time of 
field coding, and the frame reference indices spec- 
ifying frames which are referred to at the time of 
frame coding. 

20 

26. A moving picture decoding apparatus for perform- 
ing decoding with switching between frame decod- 
ing and field decoding adaptively on a block-by- 
block basis in a picture, comprising: 

25 

an assignment unit operable to assign field ref- 
erence indices to fields using frame reference 
indices, the field reference indices specifying 
fields which are referred to at the time of field 
decoding, and the frame reference indices 30 
specifying frames which are referred to at the 
time of frame decoding; and 
a decoding unit operable to decode the frames 
specified by the frame reference indices or the 
fields specified by the field reference indices. 35 

27. A program for causing a computer to execute a 
moving picture coding method for performing cod- 
ing with switching between frame coding and field 
coding adaptively on a block-by-block basis in a pic- *o 
ture, the program causing the computer to assign 
field reference indices to fields using frame refer- 
ence indices, the field reference indices specifying 
fields which are referred to at the time of field cod- 
ing, and the frame reference indices specifying *s 
frames which are referred to at the time of frame 
coding. 



28. A program for causing a computer to execute a 
moving picture decoding method for performing de- so 
coding with switching between frame decoding and 
field decoding adaptively on a block-by-block basis 
in a picture, the program causing the computer to 
assign fiejd reference indices to fields using frame 
reference indices, the field reference indices spec- ss 
ifying fields which are referred to at the time of field 
decoding, and the frame reference indices specify- 
ing frames which are referred to at the time of frame 
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Fig. 5 
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Fig. 6 
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Fig. 10 
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Fig. 19 
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Fig. 26 
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Fig. 27 
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